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Development History [edit] 


Metalink 3.0 was publicly released in 2005. It was designed to aid in downloading Linux ISO images and other large 
files on release day, when servers would be overloaded (each server would have to be tried manually) and to repair 
large downloads by replacing only the parts with errors instead of fully re-downloading them. It was initially adopted by 
download managers, and was used by open source projects such as OpenOffice.org and Linux distributions. A 
community developed around it, more download programs supported it (including proprietary ones) and it saw 
commercial adoption. In 2008, the community took their work to the Internet Engineering Task Force which resulted in 
Metalink 4.0 in 2010, described in a Standards Track RFC. Metalink 3.0 (with the extension .metalink) and Metalink 
4.0 (with the extension .meta4) are incompatible because they have a slightly different format. In 2011, another 
Standards Track RFC described Metalink in HTTP header fields. 


Client programs [edit 

e aria2 (GPL) is a Unix/Windows command line download utility that supports BitTorrent and Metalink 
(HTTP/FTP/BitTorrent) 

cURL is a computer software project providing a library and command-line tool for transferring data using various 
protocols. 

DownThemAll (GPL), a Firefox extension and download manager that has basic Metalink support. 

FlashGot (GPL), a Firefox extension for integrating with many Download Managers, supports Metalink. 

Free Download Manager (GPL), a Windows Download Manager, supports Metalink (HTTP/FTP) in version 2.5. 
GetRight 6, a Windows Download Manager, supports Metalink (HTTP/FTP/BitTorrent). 
jDownloader is an open source download manager written in Java. 


e KGet (GPL), KDE's native download manager, supports Metalink in KDE 4. 
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e Net Transport, a Windows Download Manager, supports Metalink. 

Orbit Downloader, a Windows Download Manager, supports Metalink (HTTP/FTP). 

Phex (GPL), a Mac/Unix/Windows gnutella client, supports Metalink downloads along with exporting a library to 

Metalink for sharing between users. 

e Retriever is a closed source cross platform Java download manager that supports Metalink and BitTorrent. 

e SmartFTP, a Windows GUI FTP client, supports Metalink for adding files to an FTP transfer queue and hash 
verification. 

e VeryCD's easyMule (version 1 is GPLed) is a version of eMule with Metalink support. 

e wxDownload Fast (GPL) is a Mac/Unix/Windows download manager that supports Metalink (HTTP/FTP). 

e yum, an open source command line package management utility for RPM-compatible Linux operating systems, 
uses Metalink internally, invisible to the user. 

e ZYpp, the package management engine that powers YaST2 and Zypper, supports Metalink for downloading. In the 
beginning it used aria2 internally, meanwhile (since Jul. 2010) its own libcurl based implementation 
See also: Comparison of download managers 


Client Libraries pedit] 


e libmetalink (MIT License) is a Metalink library written in C. It provides the parsing of Metalink XML files to 
programs written in C and uses Expat (library) or libxml2. It does not handle the actual downloading of files. It is 
used by cURL and other client programs. 

e metalink-checker (GPL) is a command line downloader written in Python that supports multi-source downloads 
and chunk checksums, as well as checking mirrors. It can also be used as a Python library. 


In use [edit] 


Mandriva Linux has integrated Metalink into package management with urpmi and aria2. Fedora has integrated 
Metalink into package management with yum. openSUSE has integrated Metalink into package management with 
ZYpp and aria2. 


Wubi, the Windows-based Ubuntu installer, uses Metad| (LGPL) to download Ubuntu ISO images and takes 
advantage of Metalink's features of higher availability and increased reliability. If there are errors in the download, 
they are repaired, instead of restarting the large download. 


Appupdater (GPL) for Windows "is similar to apt-get or yum on Linux. It automates the process of installing and 
maintaining up to date versions of programs." 


Currently, OpenOffice.org uses Metalinks to distribute their free office suite. CURL offers Metalinks of their downloads. 
UniProt Consortium also provides a Metalink for their large protein database. Dofus, a Flash MMORPG uses 
Metalinks for downloads and so does Sage, the open-source mathematical software. 


The software hosting and collaboration platform Origo generates Metalinks for all hosted releases. 


The following Linux distributions use Metalink for ISO image distribution: 64 Studio, Adios, Bayanihan Linux, Belenix, 
Berry Linux, BLAG Linux and GNU, Bluewhite64 Linux, Damn Small Linux, Fedora, GoboLinux, Granular Linux, 
KateOS, Linux Mint, openSUSE, Pardus Linux, PCLinuxOS, PuppyLinux, Sabayon Linux, StartCom Enterprise Linux, 
SUSE Linux, Ubuntu. 


The following FreeBSD based distributions use Metalink for ISO image distribution: DesktopBSD, MidnightBSD, PC- 
BSD and TrueBSD. 


File based search engine findthatfile provides search for Metalinks. 


Metalink client feature comparison [edit] 
A guide to which clients support which Metalink features: 
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HTTP with 
Transparent 
Negotiation 


Piece Hashes 


Signatures 


No clients support rsync at this time. 


Metalink generation [edit] 


Metalink is formatted as XML so it can be either hand-crafted or created with an XML library, useful for automation. 
These tools are specifically for Metalink. 


e Bouncer is "database driven mirror management app that has three main components - a bounce script, a 
sentry script to check mirrors and files for integrity and a set of web-based administration tools." Bouncer supports 
Metalink via a patch that has not yet been integrated upstream. 

e Geo McFly (GPL) is an on the fly generator of metalinks based on the downloader's geographical location, 
written in Python. 

e Metalink Editor (GPL) is a Cross Platform GUI Metalink editor written in Python which allows you to create and 
edit Metalinks. 

e Metalink Library (GPL) is a Cross Platform Metalink library for Python and PHP based on Metalink Editor with 
many automatic features and an easy command-line interface to generate Metalink and Torrent files. 

e Metalink Generator can also be used to create Metalinks by filling out a Web form. 

e Metalink tools (GPL) Unix/Windows command line tools for generating Metalinks with hashes and mirror/p2p 
lists. 

e Dynamic online metalinks based on metadata. Automatically created metalinks based on metadata published by 
each mirror. 

e MirrorManager& (MIT X11 license) is used by the Fedora Project for dynamically listing mirrors. 

e MirrorBrain (GPL, Apache License) is a real-time Metalink generator and download redirector. It can either 
return Metalinks, or automatically redirect non-Metalink clients (per HTTP redirection) to a mirror server near 
them. Transparent negotiation of Metalinks, embedding PGP signatures, Metalink/HTTP and other advanced 
features are supported. It is used for instance by openSUSE and OpenOffice.org. 

e Origo is anewand easy to use software development and hosting platform for open and closed source projects. 
Among many features, it has easy release management and mirroring with automatic metalink generation. 


Example Metalink 4.0 .meta4 file geait] 


Metalink 4.0 files have the extension .meta4 and are XML text files. They are served with the 
application/metalink4+xml Internet media type. 


<?xml version="1.0" encoding="UTF-8"?> 
<metalink xmlns="urn:ietf:params:xml:ns:metalink"> 
<published>2009-05-15T12:23:23Z</published> 
<file name="example.ext"> 
<size>14471447</size> 
<identity>Example</identity> 
<version>1.0</version> 
<language>en</language> 
<description> 
A description of the example file for download. 
</description> 
<hash type="sha-256">3d6fece8033d146d861leab4£032d£738c8c1283620fd02al f2bfec6e27d590d</hash> 
<url location="de" priority="1">ftp://ftp.example.com/example.ext</url> 
<url location="fr" priority="1">http://example.com/example.ext</url> 
<metaurl mediatype="torrent" priority="2">http://example.com/example.ext.torrent</metaurl> 
</file> 
</metalink> 


Example Metalink/HTTP header fields eai] 


Metalink in HTTP header fields makes use of existing standard HTTP header fields such as ETags, Link header fields 
(for mirrors and P2P), and Instance Digests (for hashes). 


Etag: "thvDyvhfIgqlvFe+A9MYgxAfmlq5=" 

Link: <http://www2.example.com/example.ext>; rel=duplicate 

Link: <ftp://ftp.example.com/example.ext>; rel=duplicate 

Link: <http://example.com/example.ext.torrent>; rel=describedby; type="application/x-bittorrent" 

Link: <http://example.com/example.ext.meta4>; rel=describedby; type="application/metalink4+xml" 

Link: <http://example.com/example.ext.asc>; rel=describedby; type="application/pgp-signature" 

Digest: SHA-256=MWVkMWOxYTRiMzk5MDQ0MzI3NGUS5NDEyZTk5SOWY1ZGFmNzgyZTJLODYzYjRjYZFhOTImNTOQwY z12M2QwM2U2M0== 


Example Metalink 3.0 .metalink file edit] 
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Metalink 3.0 files have the extension .metalink and are XML text files. 


<?xml version="1.0" encoding="UTF-8"?> 
<metalink version="3.0" xmlns="http://www.metalinker.org/"> 
<files> 
<file name="example.ext"> 
<verification> 
<hash type="md5">example-md5-hash</hash> 
<hash type="shal">example-shal-hash</hash> 
<signature type="pgp"/> 
</verification> 
<resources> 
<url type="ftp" location="us" preference="90">ftp://ftp.example.com/example.ext</url> 
<url type="ftp" location="uk" preference="90">ftp://ftp.example.net/example.ext</url> 
<url type="http" location="us" preference="90">http: //example.com/example.ext</url> 
<url type="http" location="de" preference="90">http: //example.net/example.ext</url> 
<url type="bittorrent" preference="100">http://example.org/example.ext.torrent</url> 
<url type="rsync"/> 
<url type="magnet"/> 
<url type="ed2k"/> 
</resources> 
</file> 
</files> 
</metalink> 


See also [edit] 

e ed2k URI scheme 

e Magnet URI scheme 

e Named data networking 


References [eit] 


External links [edit] 
e Official website 
e Making Metalinks article 


Metalink standard 


e RFC 5854 - "The Metalink Download Description Format" 
e RFC 6249 -"Metalink/HTTP: Mirrors and Hashes" 
e Metalink 3.0 Specification 4 


vte Download managers 
Client software for downloading computer files 


CryptLoad - Download Express - FlashGet - Free Download Manager - Free Studio - 
Freeware Freemake Video Downloader - Internet Download Accelerator - Orbit Downloader - 
Microsoft Windows RealDownloader - Xunlei - 


DownloadStudio - Download Accelerator Plus - GetRight - GolZilla - 
Internet Download Manager - 


Unix-like (e.g., OS X & Linux) GWget - KGet- 
Multi-platform CURL - DownThemAll! - FlashGot - JDownloader - Tucan Manager - Wget - 


Shareware 


Related articles Comparison of download managers - Download acceleration - Metalink - Segmented file transfer - 


Categories: Distributed data storage | Download managers | Internet Protocol based network software 
XML-based standards 
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